New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add retry when loss is NaN in train and finetune #672

Closed

rayrayraykk wants to merge 1 commit into alibaba:dev/llm from rayrayraykk:retry_batch

Collaborator

rayrayraykk commented Aug 1, 2023

No description provided.


          add retry

7507b9a

rayrayraykk requested a review from qbc2016

August 1, 2023 02:22

Collaborator Author

rayrayraykk commented Aug 1, 2023 •

edited

Loading

@HarliWu Please hv a look at this change. To maintain the consistency of the experiment, we do not merge this PR for the time being.

Collaborator Author

rayrayraykk commented Sep 6, 2023

rayrayraykk closed this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet